Adaptive high fidelity reproduction system

ABSTRACT

Audio is adaptively associated with speakers, depending on the speaker configuration that is present. Each speaker it receives an audio assignment based on its individual spectral characteristics. As more speakers are added, content is adaptively associated with that you speaker, and taken away from the previous.

[0001] This application is a divisional of U.S. application Ser. No.09/799,460 filed Mar. 5, 2001.

BACKGROUND

[0002] High fidelity systems attempt to simulate the sound that comesfrom actual sound-producing objects. Real music is produced when each ofa plurality of different instruments, at a different location, producesits own unique sound. Each instrument also has unique sonic tuningcharacteristics. The real music is produced from these instruments, atdifferent locations, producing sounds. Producing a simulation of thisreal music is the objective of a high fidelity music reproductionsystem.

[0003] Movies, in contrast, actually have a different objective fortheir sound production. In the 1980s, movie sound became a format withmultiple channels providing the sound output. This format, calledsurround sound, produced five or more channels of sound. The channelsincluded left and right main channels for stereo music. A center channelwas used for mono parts of the reproduction such as the voice. Inaddition, left and right surround channels were provided for specialeffects. In addition, additional channels may be provided for soundhaving special characteristics such as sub woofers. This sound systemattempts to produce the feeling of actually being part of the actiondepicted by the movie.

SUMMARY

[0004] The present inventor believes that an ideal musical reproduction,like real music, should produce the sound from a plurality ofinstruments, each coming from its own tuned source that has tuning/musicreproduction characteristics that is most closely representative of theinstrument. The current system of stereo reproduction reproduces most,if not all, instruments, from two different sources (speakers), both ofwhich are tuned the same.

[0005] According to the present system, information is produced forreproduction by music reproduction hardware. The information as producedhas a number of separated parts. That is, each stream of audioinformation, such as a song, may have separated parts that form thatstream. In one embodiment, those parts may be tracks on the audioreproduction medium.

[0006] The separated parts are adaptively associated with differentmusic reproduction hardware based on the actual characteristics of thehardware producing the music. That is, for example, the violin soundsmay be produced by the speaker most closely tuned to violins. Anotherspeaker, e.g., most closely tuned to horns, may reproduce the horns.

[0007] Another aspect automatically determines specific characteristicsof the hardware, and forms a file indicative of those specificcharacteristics of the hardware. The contents of that file is used toadaptively associate the content of the media, e.g., the music, with thehardware.

BRIEF DESCRIPTION OF THE DRAWINGS

[0008] These and other aspects of the invention will be described indetail with reference to the accompanying drawings, wherein:

[0009]FIG. 1 shows a block diagram of the system;

[0010]FIG. 2 shows a wired connection between amplifier and speaker;

[0011]FIG. 3 shows shows a wireless connection;

[0012]FIG. 4 shows a flowchart of operation;

[0013]FIGS. 5A-5D show different ways of storing information for use inthe present application.

DETAILED DESCRIPTION

[0014] Modern audio reproduction media may have more space for storingthe data that is indicative of the audio. For example, the so-called DVDmay have 100 times the storage capability of a standard CD, also knownas a “Redbook” format CD. Various enhanced CD formats have also beensuggested which provide more data on the media and that can be used tostore more information. In addition, modern compression formats, such asthe MP3 format, allows reducing the size that is occupied by informationplaced on the media. Again, this has the effect of allowing the media tostore more information.

[0015] Broadband channels are also available. For example, satelliteradio channels are proposed. Broadband Internet channels have been used.In addition, audio content may also be produced over a cable and thelike.

[0016] The present system will be described with reference toinformation being stored on the audio medium. A plurality of tracks areprovided on the medium. The tracks each include information about adifferent aspect of the audio stream that is recorded on the medium. Theaudio medium is shown here as being a disk, but it could be understoodthat any different kind of audio containing medium could be used withthe system of the present invention.

[0017] Each track may represent a specified kind of information. In oneaspect, each track includes information about the same kind ofinstruments. The instruments included on a single track may be of thesame time, e.g. all violins, or may have the same spectralcharacteristics, that is all string instruments, or all producing outputwithin a specified spectral region, or primarily within a specifiedspectral region. Sounds may be grouped based on spectralcharacteristics, e.g., by using a fast Fourier transform on recordedsound from the instrument. Each instrument may be characterized on thespectrum, e.g. by forming a histogram indicating that amount of energyin each spectral bucket. Alternatively, instruments or sounds which mayeffectively compress may be grouped together. The instruments which aresufficiently similar may be grouped together as a track. This has anumber of advantages in the context of the present system. First of all,it makes the information on the track more compressible by certaincompression systems such as MP3, since each instrument on the track hassimilar characteristics. In addition, on readout, the track can beaccurately reproduced by the same kind of reproduction equipment.

[0018] Multiple tracks are placed on the medium for different purposes.For example, a single medium may include movie style tracks such asleft, right, center, left surround and right surround, and also asubwoofer setting. The left and right tracks on the medium represent thestereo information. The remaining information in the tracks mayrepresent information from different individual instruments orinstrument types. This information may include separate tracks for eachof voices, strings, winds, guitar, percussion, bass strings, and basswinds, with the understanding that a each different instrument may alsobe broken up based on its characteristics e.g. bass or treble. The abovehas described 13 tracks for each stored item of information. It shouldbe understood, however, that there may be fewer or more tracks, e.g. upto 20 tracks. Since each track may represent information of thespecified instrument type, the information in the track may be highlycompressible.

[0019] As can be seen from the above, the medium will typically includemore information that is necessary to actually playback the audio on anysystem. For example, the medium may include stereo left and stereo rightchannels. However, on some systems, 10 speakers may be provided fordifferent instrument types, and this information includes parts of theinformation that is also within the left and right stereo. If theseparated channels are used, the audio left and audio right informationmight not be used. Therefore, the audio medium may include redundantinformation. Adaptive decisions are made during playback indicatingwhich speakers and or which music reproduction equipment gets whichcontent.

[0020] An embodiment is shown in FIG. 1. A disk 100 includes a pluralityof tracks of information. For example, if the tracks above are used, thestream, shown as 110, may include 13 different channels. The medium mayalso include control track 105 which may be a data track includinginformation about which tracks on the medium include which information.

[0021] The medium is read out by a player. The contents of the medium isinterpreted by the adaptive element that is either in the player, or ina controller or amplifier associated with the player. The adaptiveelement is shown herein as 150, and as being part of the amplifier.

[0022] The amplifier is connected to a plurality of different speakersor different amplified speakers. Each speaker system, such as 155, hasspecified spectral and/or other sound producing characteristics. In anembodiment, each speaker may also be active, in the sense that itincludes an electronic module associated with the speaker. Thatelectronic module allows communication with the speaker, and may includeinformation about the speaker's characteristics. In another embodiment,characteristics of the speakers may be obtained in a different way.

[0023] The characteristics of the speaker may be communicated to thememory 165 over the speaker wire using serial formats such as universalserial bus, or RS 232 for example. Alternatively, the amplifier 150 mayinclude a medium reading capability shown as 170. This readingcapability may read a storage medium, such as a floppy disk, memorystick, CD, or mini CD which is inserted therein. The medium includesinformation about the speakers, which is then read from the medium, andstored in the memory. Another way of communicating information is toobtain characteristics from a public network such as the Internet.

[0024] In another aspect, each speaker that is purchased is providedwith an audio medium such as a CD or DVD. That audio medium is intendedto be played in the CD player associated with the stereo. The contentsof the CD are played as normal CD audio. However, electronic informationabout the speakers is encoded in the CD audio. Thus, this includes aspecified code that can be read by the amplifier 150, and indicates thatspeaker information follows. The following information includes speakerinformation.

[0025] The main amplifier 150 includes also a processor 170 which makesadaptive decisions about which speakers will be selected to play eachtrack or channel on the medium. This adaptive decision will be based onthe specific characteristics of the speakers, and the specificcharacteristics of the audio. The decision is based on, of course, thespecific hardware which is present in the system. More hardware,actually more speakers, in the system, will enable better sound. Whenfewer speakers are present, tracks will need to be combined. In theminimum configuration, only two speakers are present, and the standardstereo is played. Each time a speaker is added, it receives multipletracks assigned to be played to it, based on its spectralcharacteristics. This enables the user to make purchases based on theirpreferences. The user who likes the sound of strings, for example, maypurchase a speaker that is tuned to strings. When this speaker is addedto the amplifier system 150, its characteristics are stored in memory165. Playing of media will thereafter assign information from the media100 to those speakers, based on the speakers characteristics.Conversely, other speakers for horns, and other instruments may also bepurchased. Each speaker is adaptively associated with the content forthose speakers. Each extra speaker is assigned with sound, and thatsound is hence not played by the other speakers. Therefore, morespeakers allow better reproduction of the sound.

[0026] Different ways of getting the information into the memory arealso considered. FIG. 2 illustrates up plug and play type operation ofdoing this. In FIG. 2, the amplifier 250 is connected via a standardline connection to the speaker 260. The speaker 260 includes anelectronics module therein 265. The module 265 communicates with acorresponding module in the amplifier, using any serial protocol butpreferably Ethernet, USB, or RS 232. Any protocol that may communicateover a 2 wire line may be used. In this embodiment, the amplifier maypoll the speaker using a low voltage level signal. Since the signal isat a low voltage level, it will produce little if any sound out of thespeaker. However, the electronics module 265 within the speaker maystill recognize this as control signals. The speaker responds withinformation indicative of its individual spectral characteristics. Thisinformation is then stored in the memory 165 within the amplifier. Theinformation may also be used in the playback mode, to determine channelallocations for the information from the media.

[0027] A wireless alternative is shown in FIG. 3. This may use wirelessformats such as bluetooth, wireless LAN, or some other wireless format.FIG. 3 shows a bluetooth module 310 in the speaker 300. The amplifier350 also includes a bluetooth module shown as 355. Again, this systemmay operate by polling. The speaker may respond to a poll withinformation indicative of the speaker's individual characteristics. Thisinformation is then stored in the memory 165.

[0028] In any of these embodiments, the user can purchase more speakersat any time. Settings for the music are automatically determined by thecharacteristics of the speaker.

[0029] The above-described operations may operate according to theflowchart of FIG. 4, which may run in the processor 170.

[0030] At 400, the system polls all speakers. This may be carried out ateach time of power on, or may be carried out only once for example oninitial connection. The speakers may also include the capability ofdetermining room acoustics, in which case it may be desirable to pollthe speakers at each power up, or at time intervals.

[0031] At 405, the system determines settings based on the polling.These settings may optionally be displayed at 410. At 415, the contentof the tracks is adaptively associated with the user's individual stereosetup.

[0032] The above has described the information stored on the medium.This “enhanced” information may be stored on the media in a number ofdifferent ways.

[0033]FIG. 5A shows the medium being a disk with a first portion thathas normal CD stereo 500, that can be read by any CD player, andreproduced through normal stereo equipment. A second, enhanced portionof the disk 505 includes multitrack enhanced information. Since thefirst portion is then typical CD form, this setup will require that themedium have additional space available. An advantage of this system isthat the medium can be read on any standard CD player.

[0034]FIG. 5B shows another system in which the entire medium is storedin multitrack format. In this system, the standard stereo information isinterleaved with other tracks of additional information. Standard CDformat includes headers that are specified by the standard. Theseheaders include information such as P and Q parts. These headers includesignals that instruct a standard CD player to ignore certain parts ofthe data stream that is stored on the disk; those parts being reproducedonly by enhanced players. For example, CDs may include capability ofquad reproduction, and the enhanced information tracks could be labeledas quad, so that a standard player ignores this information.

[0035]FIG. 5C shows another alternative in which a dual cited disk has afirst side 520 representing normal information and a second side 525which is an enhanced disk.

[0036] While the above has described the information being present onthe disk, it should be understood that other forms of reproduction andobtaining of information are possible. All such forms are intended to beencompassed.

[0037] Other embodiments are within the disclosed invention.

What is claimed is:
 1. A method, comprising: forming informationindicative of recorded sound, including a stream of informationincluding multiple parts, which multiple parts collectively form astream of audio; reading back said multiple parts, and adaptivelydetermining an association between said multiple parts, and audioreproduction hardware that will play back said multiple parts.
 2. Amethod as in claim 1, further comprising storing said information on amedium which stores said stream of audio.
 3. A method as in claim 1,further comprising transmitting said information over a channel.
 4. Amethod as in claim 1, wherein said adaptively determining comprisesdetermining characteristics of said audio reproduction hardware, andassociating parts from said multiple parts with each item of audioreproduction hardware, based on said characteristics.
 5. A method as inclaim 4, wherein said characteristics include spectral characteristics.6. A method as in claim 4, further comprising storing saidcharacteristics in a memory associated with said audio reproductionhardware.
 7. A method as in claim 2, wherein said medium stores twokinds of information, a first kind of information associated withstandard recorded sound, and a second kind of information including saidmultiple parts.
 8. A method, comprising: forming a file indicative ofcharacteristics of each of a plurality of speakers; and storing saidfile in a controller associated with controlling audio playback fromsaid each of said plurality of speakers.
 9. A method as in claim 8,wherein said storing comprises automatically communicating said filefrom said speaker to said controller, over a wire which connects saidspeaker to said controller, and which normally carries audioinformation.
 10. A method as in claim 8, wherein said storing comprisesautomatically communicating said file from said speaker to saidcontroller, over a wireless channel.
 11. A method as in claim 10,wherein said wireless channel is via blue tooth.
 12. A method as inclaim 8, further comprising determining spectral characteristics of saidspeaker, and storing said spectral characteristics in said file.
 13. Amethod as in claim 12, further comprising determining room acoustics,and storing information indicative of said room acoustics in said file.